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Crowdsourcing Methods 
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VOTE 


VOTE 


Occasional Polling 




INVENTION SKILL VS THE ELF CITY 


2 weeks. 2 days 


Which of these two huge updates should we create first? 


4 ^ 


THE ELF CITY 


INVENTION SKILL 


Open the gates to the etven city of Prifddnas. 
Gain access to a high-level hub city, crystal gear 
and additional storylines. 




Highest total wins. 


A new skill, allowing you to invent and create 
new weapons, gear, and items that can aid you r 
production skills. Level-up the items you make 
and customise them to your taste. 

ETA: July/ Aug 


ETA: July/Aug 
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Poll Outlines 




Exhaustive polling 
• Casting players as protectors 


Occasional polling 
• Building investment in content 
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Good Poll Practice 


Put it in-game 

Show visible real-time results 


Allow a change of mind 


Understand what loads a questio 


• Reward 


• Brevity 

• Player demographics 


#GDC16 
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Poll Flaws 



“All updates should be polled” 

Players do not instinctively value or understand everything 
Expensive 

Team perceives a reduction in creativity 
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Poll Benefits 

More chatter 

Increased retention, DAU on launch 

Players are protectors 

Players feel safer 

Players more aware of each other 

‘Indie’ feel 
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Poll T akeaways 


Understand tension of poll systems: 

• Players want to vote on everything 

• Players do not value everything 

Strong engagement and retention 
Cultural shift 



Published Design Docs 



Crystal i 


FOUR TYPES OF EQUIPMENT CAN BE 

• Normal combat weaponry (Smithing level 75) 

• Tools (Smithing level 80) 

• Teleport items ( Smithing level 85) 

• Attuned combat weaponry (Smithing level 90) j 
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Good Design Doc Practice 


Choose update wisely 
Be confident in the update 
Focus on flow of user experience 
Add reasoning 
Understand level of detail 
Video and text 
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Design Doc Flaws 


Huge intensity of work 
Delays development 
Up-front design 

Potential negative impact on your current content 

Do not expect: 

• Creative feedback 

• A full deck of lenses 
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Design Doc Benefits 


More participation than you’d think 
Valuable feedback 

More realistic player understanding of content creation 

Release day is awesome: 

• Smaller expectation gap 

• Reduced orientation 

• Reduced chance of post-launch issues 

• Directs conversation where you want it 
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Design Doc Takeaways 

Expensive and time-consuming 
Suits limited range of projects 

Positive spotlight on your content 
Improves relationship between you and your players 
Release day is stress-free (kind of) 




Fully Crowdsourced Game Design 


STEP 1 


STEP 3 


STEP 4 


STEPS 
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Runelabs 


SUBMITTED IDEAS 
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Good Runelabs Practice 


Bring it ingame 

Ensure fair and dynamic trending algorithms 
Set acceptance criteria 
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Runelabs Flaws 

Limited engagement: 

• Submitting 

• Upvoting 

Appeals to specific subset 
Generates specific ideas 

• Fixes or improvements 

• Sequels 

• Fan fiction 
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Runelabs Benefits 


Improves your understanding of your players 

• What they value/don’t value 

• What ideas they generate/don’t generate 


No more “we could have done that better” 
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Runelabs Takeaways 



Core players not interested in designing their game 
Creates tension: 

• Small minority creating content 

• For a majority that doesn’t want it 


Valuable ideas generated 

Look to harness those ideas, maybe by other means 
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Crowdsourcing Methods 



X V 
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Release Schedule Survey 


*16. Please choose the five updates that you would most like to play: 

Slayer -Level 120 or Elite Skill Q Worldwide Bosses 

Build-Your-Own PvP Automatons Fossil Island 

Raids - Two More Bosses Menaphos 

High-risk Game Mode Agility Rework 

Shapeshitting Skill or Elite Skill Team vs Team Raids 

Church/Guild of You God Wars Dungeon 2 

Necromancy Skill or Elite Skill Mining and Smithing Rework 

Slayer Master Quest Q Sailing Skill or Elite Skill 

Graphical Improvement of Players Mystery Continent 

God Sagas Vampyre Quest Finale 

Underwater City Solo Boss 

New Game Client Rite of Passage Quest 

Fate of the Gods 2 Surface Construction 

Floor 61 of Daemonheim Skilling Boss 
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Release Schedule Survey 


Runelabs: Harnesses creative pla; 
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Takeaways 





Crowdsourcing of game design: 

• Limited number interested 

• Limited shape of ideas 

Could it be done?... 

Perhaps, with a game built around the concept 

But we would be trying to solve a problem that isn’t there 
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Takeaways 


Bringing players into process 

• More conversation - sine wave to constant 

• Greater engagement 

• Greater retention 

• Focused release day 

Cultural shift in relationship with our player base: 

• They understand the community 

• They understand design difficulties 
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